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(54) Title: SYSTEM AND METHOD FOR AUDITORIALLY REPRESENTING PAGES OF HTML DATA 



(57) Abstract 

A method for representing HTML documents auditorially includes the steps 
of assigning (214) unique sounds to HTML tags and events encountered in an 
HTML document, producing the associated sounds whenever those tags or events are 
encountered (218), and representing encountered text as speech (220). Speech and 
non-speech sounds may be produced simultaneously or substantially simultaneously. 
A corresponding system (10) is also disclosed. 
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What is claimed is: 

CLAIMS 

1. A method of representing HTML documents auditorially , the 
HTML document including text and at least one HTML tag, the 

5 method comprising the steps of: 

(a) assigning a sound to an HTML tag encountered in a 
document (214) ; 

(b) producing the assigned sound whenever the HTML tag 
associated with the sound is encountered (218) ; and 

10 (c) producing speech representing text encountered in the 

HTML document (220) . 

2. The method of claim 1 wherein steps (b) and (c) occur 
substantially simultaneously. 

3. The method of claim 1 wherein step (c) further comprises 
15 (c-a) producing speech representing text encountered in 

the HTML document; and 

(c-b) including pauses in the speech representing 
punctuation encountered in the HTML document. 

4. The method of claim 1 further comprising the steps of 

20 (d) accepting input indicating selection of a particular 

HTML tag; 

(e) auditorially displaying a new HTML document 
identified by the selected tag. 

5. The method of claim 1 further comprising the steps of: 

25 (f) altering a sound whenever a sound altering HTML tag 

is encountered; and 

(g) halting a sound whenever a sound halting HTML tag is 
encountered. 

6. The method of claim 1 further comprising the step of 

30 replacing a textual construct with a text passage before step 
(c) . 

7 . The method of claim 6 wherein said replacing step 
comprises replacing an electronic mail address with a text 
passage before step (c) . 

35 8. A system for representing HTML documents auditorially, the 
system comprising: 
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a parser (12) receiving a HTML document and 
outputting a tree representing the received document; and 

a reader (14) using the tree to produce sound 
representing the text and tags contained in the HTML 
5 document. 

9 . The system of claim 8 wherein said parser produces a tree 
having at least one node, said at least one node representing 
a HTML tag. 

10. The system of claim 9 wherein tag attributes and tag 
10 attribute values are attached to each node. 

11. The system of claim 8 wherein textual data contained in 
the HTML document is represented as leaf nodes of the tree. 

12 . The system of claim 8 wherein said reader performs a 
depth-first traversal of the tree to produce sound 

15 representing the texts and tags contained in the HTML 
document . 

13 . The system of claim 8 further comprising a read cursor 
indicating the position within the parsed HTML tree that said 
reader is currently outputting. 

20 14. The system of claim 13 wherein the position of the read 
cursor can be changed, causing a different position of the 
parsed HTML document to be output. 

15. The system of claim 8 further comprising an enqueue 
cursor indicating the position within the parsed HTML tree 

25 that will be processed for output by said reader. 

16. An article of manufacture having computer-readable 
program means for representing HTML documents auditorially 
embodied thereon, the HTML document including text and at 
least one HTML tag, the article of manufacture comprising: 

30 (a) computer- readable program means (214) for assigning 

a unique sound to an HTML tag encountered in a document; 
(b) computer-readable program means (218) for producing 
the assigned sound whenever the HTML tag associated with 
the sound is encountered; and 

35 (c) computer-readable program means (220) for producing 

speech representing text encountered in the HTML 
document . 

17. The article of claim 16 further comprising: 
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(d) computer-readable program means for accepting input 
indicating selection of a particular HTML tag; and 

(e) computer-readable program means for auditorially 
displaying a new HTML document identified by the selected 
tag. 
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Detailed Description 
. . . that it can 

represent the end of that tag in sound as well. 

The reader maintains two cursors as it traverses the tree 
data structure. A cursor is a reference to a particular 
position , or node, within the tree. The first cursor 
represents the position within the parsed SGML document tree 
which is currently being sonified, and will be referred to as 
the "read cursor". The second cursor represents the... 



Claim 

. . . represented as leaf nodes of the 
tree . 



12 The system of claim 8 wherein said reader performs a 
depth- first traversal of the tree to produce sound 
representing the texts and tags contained in the SGML 
document . 



13 The system of claim 8 further. . . 

. . .position within the parsed SGML tree that 
said reader is currently outputting. 



14 The system of claim 13 wherein the position of the read 

cursor can be changed, causing a different position of 
the parsed SGML document . to be output . 
. The system of claim 8 further comprising an enqueue 
cursor indicating the position within the parsed SGML. . . 
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Detailed Description 
that it can 

represent the end of that tag in sound as well . 

The reader maintains two cursors as it traverses the tree 
data structure. A cursor is a reference to a particular 

position , or node, within the tree. The first cursor 
represents the position within the parsed HTML document tree 
which is currently being sonified, and will be referred to as 
the "read cursor". The second cursor represents the... 

Claim 

... represented as leaf nodes of the tree. 

12 The system of claim 8 wherein said reader performs a 
depth- first traversal of the tree to produce sound 
representing the texts and tags contained in the HTML 
document . 



13 The system of claim 8 further. . . 

.position within the parsed HTML tree that said 
reader is currently outputting. 

14 The system of claim 13 wherein the position of the read 
cursor can be changed, causing a different position of the 

parsed HTML document to be output . 
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..SPECIFICATION address of page frame 111 and an offset portion 107 of 
linear address 109 provides an offset to physical memory location 112. 
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Claim 

and XPointer expression; an XL INK 
expression; an Internet Explorer (IE) Markup Pointer 
identifying contents in a browser; an absolute 
character position in a stream-based HTML document 
model; and an object naming identification mechanism in 
a DHTML model. 

22 A peer-to-peer communication system according 
to claim 21 wherein said identification mechanism 
comprises an XPointer expression, and further wherein 
is said XPointer expression is constructed by walking 
backwards through the DOM tree until finding the 
earlier of the root or the ID 
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1066 traverses the Concept Tree 1054 in a top-down fashion. It first 

encounters the OR operator. It then checks the first sub-expression of... 
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... of all nested elements. The selection process is greatly shortened 
14 

by focusing the selection control 704 around the initial location of 
the user's click on the page 420. A slider 708 then enables the user to 

walk up and down the DOM hierarchy tree from that initial location. 
By slightly altering the storage of the snippet 904, it is possible to 
share alerts . . . 
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Claim 

... object is a single node or a multi-instance node. 

The routine 1950 begins at block 1954, where the source document at the 
source location is read. Depending on the source data type, CROM calls 



a reader to generate a source data tree object. At... 

.is read. The file is then parsed to create the target STRUCT tree 
object. At block 1958, the target STRUCT tree object is " walked " to 
visit each node in the tree. Walking a tree in this manner is well know 
to those skilled in. . . 
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... since the first page accessed (e.g. through a bookmark) was page e, 
this is at the top of the hierarchy . A user may subsequently traverse 
the entire web site in the order shown by the numbers. The pages are 
arranged in the session hierarchy according to these numbers with pages 
at the same horizontal level indicating the same position within the 
hierarchy. 

Hypertext documents are viewed in some sequence by each reader, 
moving 

1 5 from one to another by choosing "links" within each. . . 
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... since the first page accessed (e.g. through a bookmark) was page e. 
this is at the top of the hierarchv . A user may subsequently traverse 
the entire web site in the order shown by the numbers. The pages are 
arranged in the session hierarchy according to these numbers with pages 
at the same horizontal level indicating the same position within the 
hierarchy. 

Hypertext documents are viewed in some sequence by each reader . 
moving 

from one to another bv choosincy "links" within each page. Where. .. 
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Detailed Description 

case the location of the source file structure 700) and the location 
of a 'target' directory into which the 'templated' Web pages may be 
output . 

Given the location of the source file structure 700, as with the first 
and second embodiments, when invoked the tool will first perform a 
so-called ' tree traversing ' procedure, in a top down fashion. Yet 
again in the course of this first procedure the branching form of the... 



15/3, K/10 (Item 8 from file: 349) 

DIALOG (R) File 34 9:PCT FULLTEXT 
(c) 2005 WIPO/Univentio. All rts. reserv. 



00432417 **Image available** 

REMOTE ACCESS IN A GLOBALLY ADDRESSABLE STORAGE ENVIRONMENT 
ACCES A DISTANCE DANS UN ENVI RONNEMENT DE STOCKAGE ADRESSABLE 

Patent Applicant /Assignee : 

MANGOSOFT CORPORATION, 
Inventor (s) : 

CARTER John B, 

DAVIS Scott H, 

FRANK Steven J, 
Patent and Priority Information (Country, Number, Date) : 

Patent: WO 9822881 Al 19980528 

Application: WO 97US21460 19971121 (PCT/WO US9721460) 

Priority Application: US 96754481 19961122; US 97827534 19970328; US 
97850364 19970502 
Designated States: 

(Protection type is "patent" unless otherwise stated - for applications 
prior to 2004) 

AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU 
ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ 
PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW GH KE LS MW 
SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE 
IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG 

Publication Language: English 

Fulltext Word Count: 26819 



Patent and Priority Information (Country, Number, Date) : 

Patent: ... 19980528 

Fulltext Availability: 

Detailed Description 
Publication Year: 1998 

Detailed Description 

... the global addressing memory engine level. The three. most important 1 
5 data structures at that level for managing the location and 
consistency of a shared page are the Global RAM Directory (GRD) , the 
local RAM copyset structures, and the Global Disk Directory (GDD) . The 
global directories can be managed by walking a tree from root to 
desired leaf node, Ccpaging" in the appropriate pages as you need them. 
One way to extend the . . . 
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Detailed Description 

. . . page frame 111 and an offset portion 107 of linear address 109 
provides an offset to physical memory location 112. 

The compressed page mapping hierarchy 360 parallels address mapping 
hierarchy 350 and the same I 0 directory index 105 and table index 106 
portions of linear address 109 are used to traverse both hierarchies . 

However, unlike the address mapping hierarchy 350 which maps a full 
32 -bit linear address to a physical memory location , the compressed 
page mapping hierarchy 360 maps from a linear page to a compressed page 
(i.e.,ftom the page in the linear... 
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Detailed Description 
... an 

example of the representative embodiment of the Document 
Location Box 70 which is displayed whenever the user 
selects the document location button 22 on the save card 
20 of Fig, 2 or the document location button 44 on the 
open card 40 of Fig. 4. Figs. 6a to 6e show the 
different displays in the Document Location Box 70 as the 
user traverses the real world hierarchical file structure 
9. 

The Document Location Box 70 is divided into two windows 
71 and 72 called the select window 71 and the path window 
72. . .The rename button 82 

allows the user to rename levels or files. 

Figs, 6a- 6e show the state of the Document Location Box 
70 as the user traverses the real world hierarchical file 
structure 9. The first screen displayed to the user when 
user enters-the Document Location Box 70 (ie.,.when the 
user activates the document location button 44 on the 
open card 4 0 of Fig. 4) is shown in Fig. 6a. The path 
window 72 is . . . 

. . . door icon 

76-78 represent the first defined level in the real world 
hierarchical file structure 9. The user, to traverse the 
real world hierarchical file structure 9, must select one 
or more of the door icons 76-78, 

Assuming that the user selects the 11AGI Investments" icon 
76 then the state of the Document Location Box' 70 will be 
that shown in Fig. 6b. The door icon 76 that was 
selected by the user now. . . 
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Set Items Description 

51 13809 WEB PAGE? ? OR (WEB OR INTERNET OR HTML OR HYPERTEXT??? OR - 

HTTP) OPAGE? ? OR (HTML OR XML OR (MARKUP OR MARK () UP) () LANGU- 
AGE OR HYPERTEXT) (1W) (FILE? ? OR DOCUMENT? ?) 

52 1083385 DOCUMENT? ? OR PAGE OR PAGES OR ARTICLE? ? OR TEXT 

53 22926 (POSITION OR LOCATION) (5N) (CURSOR OR POINTER OR ARROW OR M- 

ARKER OR INDICATOR) 

54 102 S1:S2(7N) (CURRENT(2W) (POSITION OR LOCATION OR SPOT) ) 

55 23140 (POSITION OR LOCATION) (7N)S1:S2 

56 69302 TREE OR TREES OR HIERARCH? 

57 274 S6 (5N) (WALK??? OR TRAVERS???) 

58 667 (POSITION OR LOCATION) ( 5N) SI : S2 ( 5N) (CURSOR OR POINTER OR A- 

RROW OR MARKER OR INDICATOR) 

59 0 (S4 OR S8) AND S7 

510 18 (S4 OR S8) AND S6 

511 0 PARSE () TREE? ? AND (S4 OR S8) 

512 3 AU= CORONA G? 

513 7 S10 AND AC=US/PR 

514 6 S13 AND AY= ( 1970 : 2001 ) /PR 

515 8 S10 AND PY=1970:2001 

516 9 S14:S15 

517 1 S5 AND S7 
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ABSTRACT 

PROBLEM TO BE SOLVED: To provide an information recording medium capable of 
describing text information on individual hierarchies and rapidly 
retrieving the text information by relating a text to a hierarchical 
structure with a hierarchical information piece. 

SOLUTION: A text head pointer 12 9b as a text arrangement information 
piece showing the position of the text recorded as a character code line 
in an item text part 13 0 and an item code 12 9a as text correspondent 

hierarchical information piece or a kind information piece are recorded 
as a pair in an item text pointer 12 9. In the information recording medium 
constituted in such a manner, since the text is related to the 

hierarchical structure by the hierarchical information piece, provision 
of a text for each of plural hierarchies becomes possible. Further, since 
the text arrangement information piece showing the arrangement of the text 
information piece is incorporated, the text information is retrieved 
rapidly. 
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ABSTRACT 

PURPOSE: To efficiently execute a program editing operation by 
automatically switching an input mode by means of shifting a cursor to a 
non- terminal symbol position. 

CONSTITUTION: A non- terminal symbol is displayed by the screen output of a 
syntax template. Namely, the non- terminal symbol position turns into a 

text input position and a user shifts the cursor to the non- terminal 
symbol position . At the time, a text in a position to which the 

cursor has shifted and a tree are read whenever the cursor is shifted, 
and a character in the position of the cursor is decided to be a 
non-terminal symbol or not. If it is recognized to be the non- terminal 
symbol, the input mode is set to a text input mode. If the present 

position of the cursor is on the non- terminal symbol and the position 
of the cursor is positioned except on the non- terminal symbol as the result 
of the shift of the cursor, the input mode is switched from the text input 
mode to a common input mode. Thus, the user can switch the input mode only 
by the shift of the cursor without switching the mode. 
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ABSTRACT 

PURPOSE: To heighten the efficiency of edition by storing places on a 
document for which edition indication is performed and their edition career 
information and restoring the places indicated in response to cursor 

position to the document before edition indication referring to the 
edition career information. 



CONSTITUTION: A document edition control section 3 judges whether edition 
career is to be recorded or not according to edition indication operation 
information inputted from an input control section 2 through an input 
device 1, and analyzes document edition operation indication and gives a 
command to a document editing section 6. The result of edition in the 



editing section 6 is stored in a document and edition career storing 
section 5, and at the same time, an edited document is outputted to an 
output device 8 through an output control section 7. An edition career 
operating section 4 records the career of editing operation and records the 
result in the storing section 5 in tree structure. Further the section 
takes out career of places indicated responding to cursor position 
according to information from the control section 3 that commands 
documents restoration, and outputs to the device 8 through the control 
section 7. Thus, the restoration can be made to the document before edition 
indicating operation, and the efficiency of edition can be improved. 
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Abstract (Basic) : US 20020046205 Al 

NOVELTY - The address of an item and its map pointer are received 
and stored. If the address in the map index is not empty, it is 
determined whether the duplicate indicator is set. If not, a duplicate 
array is selected and the existing map pointer is stored, at the 
address in the map index, in a location of the duplicate array. 

DETAILED DESCRIPTION - INDEPENDENT CLAIMS are included for the 
following : 

(1) Hierarchical structured data document system having a 
duplicate tree structure; and 

(2) Hierarchical structured data document system operating 
method. 

USE - For using duplicate tree structure for structured data 
documents such as hypertext markup language (HTML) , standard 
generalized markup language (SGML) and extensible markup language 
(XML) . For Internet and other business applications using XML. 

ADVANTAGE - Reduces the size of structured data documents and 
increases the ease of storage. Requires less memory to store and less 
bandwidth to transmit. Significantly reduces the collisions resulting 
from duplicate storage inside an associative memory. 

DESCRIPTION OF DRAWING (S) - The figure shows the flowchart 
explaining the method of storing a structured data document . 
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Abstract (Basic) : US 5917491 A 

NOVELTY - A proxy tool manipulates a page proxy displayed in a 
window using gestures. A navigation aid provides an organization view 
of page proxy destination location and actions. A cursor gesture 
is moved over for attaching to the page proxy and mouse is used for 
dragging and dropping the page proxy to navigation aid. 

DETAILED DESCRIPTION - The proxy tool has a page proxy icon (16) 
located on a menu bar proximate to a page location field (12) . The 
navigation aid has a drag drop menu that includes hierarchically 
arranged contents, including multiple levels of sub-menus. The page 
proxy manages web page locations in the form of uniform resource 
locators (URLs) as web page bookmarks. An INDEPENDENT CLAIM is also 
included for page information representation management method. 

USE - For bookmarking uniform resource locators and managing 
representations of page information in web browser such as netscape 
navigator and for managing E-mail messages. 

ADVANTAGE - Allows to retain ability within a browser for bookmarks 
to be acquired and revisited easily, thereby providing more information 
to users when organizing their bookmarks. 

DESCRIPTION OF DRAWING (S) - The figure shows schematic 
representation of a portion of browser display showing page proxy for 
bookmarking URLs . 

Page location field (12) 

Page proxy icon (16) 
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Abstract (Basic) : EP 919936 A2 

NOVELTY - The computer system allows the user to create and alter 
documents (130) . The documents consists of many parts, e.g. sections, 
chapters, paragraphs, graphics. Each of the parts can have a pointer 
associated with it. The pointers are managed by a location manager 
(102) . Separate functions, e.g. editing, searching, use the location 
manager to maintain the pointer information. Alterations to the text 
is reflected in the pointer hierarchy . 

USE - Tracking locations in electronic documents 

ADVANTAGE - Provides a central location and consistent management 
of parts of an electronic document 

DESCRIPTION OF DRAWING (S) - The figure shows a block diagram of a 
computer platform suitable for supporting a location manager in 
accordance with the invention. 

Manager of points within documents (102) 

Documents (130) 
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The system includes a retrieval unit for retrieving data from a 
desired document. The position of each document to be displayed in a 
three dimensional workspace is indicated by a pointer of a cursor 



controller (106) . The indicated documents are displayed in predefined 
positions within the workspace. The pointing position of cursor 
corresponding to selected document and downward movement of a switch 
in the pointer are detected. A line is drawn corresponding to the 
detected cursor movement. The position of cursor with respect to 
destination document and upward movement of switch are detected. 

A predefined operation is performed based on the designated 
document destination. The information in the selected document is 
displayed in comprehensive manner in a focus space by a display circuit 
(107) . The ephemeral position of various documents undisplayed in the 
focus area is displayed in an intermediate space. The unused documents 
are displayed in a tertiary space in the display surface. The flick 
operation performed by the user corresponding to the document is 
detected. Based on the detected flick position, the document reposition 
is carried out. 

USE - For display of documents downloaded from WWW in internet. 

ADVANTAGE - Facilitates display of several documents thereby raises 
accessing efficiency. Enables position of desired documents in various 
orientations according to user's view. Enables display of several 
documents according to hierarchical order. Facilitates determination 
of document position based on drawing line indicated with respect to 
flick gesture. 
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Abstract (Basic) : EP 384184 A 

The document processing system includes a central processing unit 



(10) , a random access memory (26) and a display device (21) . The method 
hierarchically contracts element marks about a reference point in a 
structured document (33) containing a stream mark, and comprises the 
steps of determining whether the reference point is inside the stream 
mark, contracting the stream mark to the largest element which is 
completely contained in the stream mark and located at the current 
document position to produce an element mark, and displaying the 
structured document emphasizing the element mark. 

USE ADVANTAGE - Capable of hierarchically contracting and 
expanding element marks. Editing and processing of structured 
documents. (25pp Dwg.No.l/5) 
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. .. are accessed according to their positions in the tree. The key to 

accessing specific element layers is the ability to traverse the tree 
structure. The root of the tree is the document object. The next level of 
the tree is accessed via the either of the following statements: 

document . layers ( 1 layerl ' ) . left += 5 ; 
document .layerl. left += 5; 

To set the left position of layer A, you would do this via layer 1 
as in any of the following: 

document . layers ( 1 layerl ' ) . document . . . 

. . .5; 

document . layerl . document . a . left += 5; 

document . layers ( ■ layerl ' ) . document . a . left += 5 ; 

As you can see, having to traverse the object tree for multiple 
layers is a chore. If you avoid nesting containers and position each 
container independently, you can avoid traversing multiple levels of the 
tree . 

Because IE and Navigator reference object attributes in different 
ways, you'll need conditional statements in your code to determine... 
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